Approximating the Gradient of Cross-Entropy Loss Function
نویسندگان
چکیده
منابع مشابه
Estimation of Lower Bounded Scale Parameter of Rescaled F-distribution under Entropy Loss Function
We consider the problem of estimating the scale parameter &beta of a rescaled F-distribution when &beta has a lower bounded constraint of the form &beta&gea, under the entropy loss function. An admissible minimax estimator of the scale parameter &beta, which is the pointwise limit of a sequence of Bayes estimators, is given. Also in the class of truncated linear estimators, the admissible estim...
متن کاملA Stress Relaxation Model with Polyconvex Entropy Function Approximating Elastodynamics
The equations of polyconvex elastodynamics can be embedded to an augmented symmetric hyperbolic system. This property provides a stability framework between solutions of the viscosity approximation of polyconvex elastodynamics and smooth solutions of polyconvex elastodynamics. We devise here a model of stress relaxation motivated by the format of the enlargement process which formally approxima...
متن کاملThe Complexity of Approximating the Entropy
We consider the problem of approximating the entropy of a discrete distribution under several different models of oracle access to the distribution. In the evaluation oracle model, the algorithm is given access to the explicit array of probabilities specifying the distribution. In this model, linear time in the size of the domain is both necessary and sufficient for approximating the entropy. I...
متن کاملOn Approximating the Entropy of Polynomial Mappings
We investigate the complexity of the following computational problem: POLYNOMIAL ENTROPY APPROXIMATION (PEA): Given a low-degree polynomial mapping p : F → F, where F is a finite field, approximate the output entropy H(p(Un)), where Un is the uniform distribution on F and H may be any of several entropy measures. We show: • Approximating the Shannon entropy of degree 3 polynomials p : F2 → F2 o...
متن کاملCovariance structure regularization via entropy loss function
The need to estimate structured covariance matrices arises in a variety of applications and the problem is widely studied in statistics. We propose a new method for regularizing the covariance structure of a given covariance matrix whose underlying structure has been blurred by random noise, particularly when the dimension of the covariance matrix is high. The regularization is made by choosing...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2020
ISSN: 2169-3536
DOI: 10.1109/access.2020.3001531